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identifiiis v-.riables and relationships among variables in four 
categories: IGE support system conponents, pupil and staff 
background, means of instruction, and pupil and- staff cutcooiss. fhe 
proposed investigation is divided into four pi!?;ses.. The first phase 
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study, the third is ar intensive study of the degree kf- refcrii and 
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use and effectiveness of two curriculuia products of the Wisconsin 
Research and Development Center for Cognitive Learning. Together ti a 
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characteristics of successful scbcoling a^ designs<5d for and practiced 
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The misbion of the Wisconsin Research and Development Center 
fur Coqnltive Learning Is to help learners develop as rapidly 
and effectively as possible theix potential as huiaan beings 
and as contributing mejuh^rs of societ/. The R&D Center is 
striving to fulfill this goal by 

• conducting research to discover more about 
how children learn 

m developing improved instructional strategies^ 

processes and materials for senool administrators, 
teachers, and children, and 

m offering assistance to educators and citizens 

which will help transfer the outcomes of research 
and development into practice 

PROGRAM 

The activities of the Wisconsin R&D Center are organized 
around one unifying theme. Individually Guided Education. 
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Th«^* Wi seems in R&D Center is supported with funds from the 
N. It zonal Institute of Ed^ication, the Bureau of Education for 
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ABSTRACT 



In this paper a plan to assess the effectiveness of the 
implementation ot Individually Guidfc*d Education (IGE) in Asnerlcan 
i'lutnentary schools Is outlined. The plan is based on a framework 
that identifies variables and relationships among variables in 
tour categories: Support system components, pupil and staff 
background, means of instruction, and pupil and staff outcomes. 
The proposed investigation has been divided into four phases. 
The first phase is a 100-school survey; the second a follow-up 
and extension study; the third, ^ an intensive study of the degree 
of reform and renewal in IGE schools. The last phase is an 
txam I nation of the use and effectiveness of the two primary 
i urrjcuium products of the Center, the Wiscojisjji 
Held in^ Skill ^>^X^^ipPP>*Pi_ Uevel ojin^ Ma^hega t leal Process es. 

Tu>^ether the four phases of this investigation have been designed 
to ivi^MUifv the characteristics of successful schooling as 
designed i oi .uul prar t i c^ d in f (iK cl i^mentary s<'hools * 
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AN OVERVIEW OF THE PROBLEM 



The Center*s program of Individually guidr.d education 
In multi-unit schoolb may prove one of the most power-* 
ftil and flexible sets of approaches yet devised for the 
continuing renewal of educational institutions and the 
facilitation of learning and teaching. It niake^ it 
possible to involve schools and other educational 
agencies in the problem-solving processes which are 
the essence of research and developiaent , It promotes 
Innovation, not as an end in itself, but as an answer 
to human needs [Chaje^ 1970, p . 2 ] . 

^ For core than a decade, the primary program of the Wisconsin 

Resi.*arrh and Development Center for Cognitive Learning has been 

Individually Cuided Education (IGE). The Center's ability to 

m^irshill hum^in and financial resources in an attempt to restructure 

1 t'mtMit ary ediuMtion in the Unlti»d Stales is remarkable and has 

been pictured as a prime example of the utility of Federal f i-- 

nanoing of educational research and development* 

Today (through the efforts of tho Center , the Kettering 

FiMindat inn and IGE coordinators in 29 stares) well over 1500 

i-lementary schools claim to be IGE sfehools. Unfortunately, 

no comprehensive picture of the extent or effectiveness of IGE 

implement at ion is now available. This is not to imply that 

evaluations of IGE have not been done. On the contrary, 



Katstnimtfyer, and Ingl^on (In prass) found approximately 50 diff«»renL 
studies directed at evaluating variousi aspects of TGE. Each of th 
studies, however, dealt with parts of the iGE system and offer 
only glltspses of thcs laspact of IGE. AlaOg more recently, an 
examination of rusponseB to an IGE Schools Questio't^ aire returned 
In June 1976 clearly indicates substantial variance in dif filiation, 
degree of utiliEation, use of the instructional prograamiing laodel 
(I?M), subject matter selected for IPH impJementation, sraff 
organization, etc. (Zajano & Stewart, 1976) . Obviously, the 
translation of IGE into practice has taken many forms. Thus, 
the purpose of thiF paper is to outline a plan to evaluate IGE 
so that both a comprehensive picture of the systeaj in operation 
and i^H effectiveness can be determined. The picture should 
illuminate the features of IGE schools which have made them 
successful • 



Thi' Mainsprings cif IGE 

The design of such an evaluation plan is not easy. IGE is 
not a product like a washing machine to be judged simply by 
performance' against competitors as in a consumer report. Rather 
It is a complex system based on theoretic and pragnsatic ideas 

abon^t schooling, children's learning, and tlie professional 

\ 

roles of school staffs. In essence, IGE is the resalt 

of a long, collaborative interplay of these ideas by various 

scholars and prof ession^*! educators* 
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The conceptual mainsprings of IGE are reflected in ti e three 
words in its title: "education." "individually." and "gMided." 
"Education" In IGE was chosen to reflect the idea that schooling 
Hhould he integral part of education. The school as a social 
agency should be purpqslve and directive, but its purposes should 
be broadly and culturally, conceived. Thus, although cognitive 
objectives are to be the referents upon which schooling ex- 
periences are based, just meeting such a list. of objectives is 
not sufficient. For exahipie. learning "to comprehend a written 
passag*'" rr "to write a mathematical expression for a oarticuiar 
Situation" are typical referents upon which instruction is based. 
But, since schooling is to be related to one's overall education, 
other purposes such as "the development of high level conceptualizing 
r.killH"CKlausmeier. 1976) or "problem solving strategies" (Romberg, 
1976) or "other abilities which enable pupils to continue to leam 
and have healthy self -concepts" (Klausmeier, 1976) are central to 
t ht' purposes o f an iGE school. 

"Individ-mlly" In IGY. was chosen to reflect that schooling 
should be directed toward each individual pupil. But, as the 
title of an ir.E film proclaims, instruction should be "one at a . 
t Isje together." This implies, that while what an individual 
lfarn<=' depends upon a specific learning experience, the ex- 
. perience usually will not be independent frora others but- rather 
as a part of a group activity with other children. Since ^ 



children differn in past experiences, i^tivation, readiness, rate, 
learning style, and expectations, they should not necessarily' learn 
the same things at the same time or in the same way. Variation in 
objectives, in when objectives are learned, and in activities de- 
signed to teach thepe objectives is expected. Also, pupils are 
iiot simply passive recipients of Infonaation. Instead they are 
active problem solvers searching fok^ information. Thus, what stu- 
dents do and how they do it are as important as what they learn. F( 
it is through the means of instruction that outcomes a^e acquired. 

"Guided" in IGE was chosen to reflect the teacher's pro- 
fessional role as pupils' guide for instruction. The teacher's 
role in IGE is succinctly specified in Steps 4, 5, and 6 of the 
IGF Instruct ion.il Programming Model (see Figure 1). Teacherc 
are viewed as professional clinicians, motivating, observing, 
challenging, and varying instructional activities to meet the 
needs and characteristics uf the pupils under their direction. 

Finally, while the above beliefs about schooling, individuals, 
aii({ teat lien; are held by many educftors, IGE is unique in that 
its developers recognized that such beliefs can only be realized 
through the creation of a supportive environment. The Center, 
in collaboration with school personnel, has developed a unique 
form of school organization (the Multlunit school) ; currir.ular 
materials ccmpatlble with the IPM [such as Wisconsin Dealgn 

Reading Ski 11 D evelopment (Otto, 1976) and Developing 
^-^M^^^tlcal P rocesses (Romberg, 1^76)]; and state, regional. 
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Figure 1. Instructional Progranciing Model in IGE. {Adapted from 
Klauameier, Quilling, Sorensonp Wayi & Glasrud, 1971, ^ 
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and national networfes to prepare and relnstruct teachers ^ unit 
leadt^rti^ qnd principals. In fact, the networks have served both 
to facilitate the itnplementation cf IGE in schoolti and to remove 
cichocls* dependency on the R&D Center. The components of IGE 
evolved and were clarified as needs arose and collaborative 
J' t forts were made to alleviate tho^e needs. The seven basic 
components which have evolved are: the snultlunit organization- 
administrative arrangements, instructional programming for the 
individual student^ evaluation for educational decision making, 
curricular materials compatible with IGE, hoiue-school-conmiuriity 
relations, facilitative environments for IGE, and the continuing 
research and development required to renew the educational 
syatt'n. These basic components are shown in Figure 2. 

Thf multiunit organization was designed to produce an 
*'nvirannient In a school building which facilitates instructional 
rrogramming for the individual student and the introduction of 
other coiaponents of IGE. iBe multiunit school organization 
struc turt? replaces the age-graded, self-contained 'classroom 
orsanizatlon for instruction and the delated ''administrative 
relationships. The Instruction and Research (I & R) Unit 
replaces the self-contained flassroom organization for instruc- 
tion. The Instructional Improvement Cbnmittee (IIC) comprised 
of the principal and the unit leader replaces the principal as 
the sole educational decision maker at the building level. 
The Systcnvide Program Coraiaittee (SPC) is a new organizational 




in.tsi-.i orrKl. ill :n<H'r, \luillinq, Horcntioii , Way, & Giasruc', 
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arra:igenient at the school district level • These three groups assume 
responsibility for planning, decision making, and evaluation at' 
the three respective levels and also for communication within the 
school setting and between the school and the community. 

Adapting instruction ' to the needs of the individual is essential 
for Improving the quality of education^ tTo attain this aiI^^ of IGE» 
a model of instructional programming (XPM) was conceptualised to 
facilitate ear \ student's development in the cognitive, psychomotor, 
and affective dotaains (Klaustaeier, Sorenson, & Quilling, 1971). 
This model specifically takes into account each student*s beginning 
level of performance, rate of progress, stvle of learning, BK>tivational 

A 

levels and other characteristics in the context of the educational 
program of the school. ^ 

Evaluative infortnation too often has been gathered to compare 
individuals and group:^ rather than to plan and carry out good in-- 
Htrwctlon for Inaivii^ual studt-nts. As a result, it has been done 
after an instructional sequence iis completed rather than before 
it is started and during the sequence. In IGE the evaluation of 
the student *s learning characteristics and achievements is aimed 
at providing information at three times: (3) at the beginning of 
a unit of ^instruct ion, (2) during the Instructional sequence, 
and (J) at the ^nd of a unit of Instruction. Thus, the thiTd 
major component of IGE is a model of evaluation leading to decisions 
which will facilitate student learning through use of instructional 
progrananing for the individual student. 

♦ 

in 



The succtrss of IGE and other forms of schooling depends heavily 
on tht? availability ol curricuL'ir materials compatible with instruc- 
tional programming for the individual student and the. availability 
of appropriate evaluative procedurt^s. Curricular materials, whethc^r 
developed for IGE or any other instructional systeiji, should Incorpori: 
tour main attributes (Klausmt. ?er, 1975). ^ First, the content incor- 
porated In the nu^terial should be accurate and reliable. Second, 
the content should be learnable by the particular students for whom 
it is prepared. Third, the materials .^'hould be suitable in tertDs of 
cost, attractiveness, and the amount ol inservice teacher education 
requ L ri'd . Fourth , the materials and re^ljited activities should be 
teachable. Fo be compatible with instructional programming for 
the individual student, teachaole materials in any curricular area 
should include (a) clearly stated instructional objectives; (b) 
assessment tools and procedures direct ly related to each objective 
that will aid teachers in tiie Initial, formative, and sununativc 
i*valuai ions of st udenf learning; (c) print and nonprint instruc- 
tional materials that will enable students to attain each objective; 
'and (d) suggestions to teachers concerning possible instructional 
activities that effectively combine the use of the materials with 
sttident and teacher activities. This last attribute of curricular 
materials assumes that each teaclier, in order to attain liny 



to vary the instructional activities for particular students in 
orler to provide for individual differences. 



particular objective that may be common for students, must be able 




> 



10 



4 



The success of any ICE school depends in>a large measure on an 
active program of home-^school-cc^mmuni ty relations. Three general 
aims of a hoine-school--coimaunl ty relatione program are that the staff 
is aware of available resources and is responsive to the educational 
expectations cf the conmiunlty, parents, and students; the community, 
parents, ;ind J5tudents are aware of and responsive to the requirements 
for implementing IG&; and both staff and community are Involved in 
tho cliangeover and refinement of IGE, 

A system of supportive and facilitative environments is re- 
quired to m^iintain, and strengthen each IGE school so that, in fact , 
oacti school becomes increasingly self-renewing. Facilitative 
i*nvl ri^nmentH , consisting of human and mterial resources^ are 
hotK i at raorRanizat lonal and ex t raorganizat ional . The intra- 

organizational envirQnme^t is represented in the multiunit organiza- 

I 

t lonal structure and the focus is providing the physical and 
m;itcrial resources needed for learning and instruction* Extra- 
organisational tacilitatlve environments are represented in the 
state educat lon-agf ncy , intermediate educational agencies, teacher 

on institutions, and other groups such as teachers' 
associations and parents' organizations. 

The seventh artd final conjponent of IGE, a program of continuing 
research and development, ensures the continuous itnprovament of 
ICK. Without this component, IGE — any any other form of schooling — 
wil? become sterile, unresponsive to the changing nature of society, 
and iucapable of adapting to the needs of individual students 
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(Klausmeier, 1972). Thus, an WZ school Is one that att»^mpts to 
incorporate these t>even components and their interrelationships 
into a total systeTn of schooling. 

•lud^ln^ the VjUue _ot^ HJE 

To devt?lop an evaluation plan f or IGE^ four ^principles have 
been followed to judge the value of ICE. 

1 . Pupil uuLcomes shoul d be the initial b asis of an IGE 

evaluation. As Klausmelcr stated 

.Students » upon completing IGE elenient^ry 
schooling, should have achieved hLghcr 
than- in other kinds of schools, should 
nave achieved conceptualizing skills and 
other abilities which enable them to 
continue to learn » and also should have 
healthy self --concepts [Klausmeler , 1976 , 
p . 7 ] . 

The extent to which these outcomes have been attained 
must be the basis of tht^ evaluation plan. 

2, The instruct iojial means or _ft)rni of formal schooling 
must be a second basis* of an IGE evaiuaLion- it has 

. , 

hvvn f aiihionab] in oval nation circles to concentrcijTf*— 
on ends or Outcomes and to ignore the means by which 
they arc reached. It has been persuasively argued 
in traditional circles t\ it means are, by definition, 
the optional routes to fixed goals.- These optional 
routes art" of no significance in aLd of thenuielves , 
btit only in t f - rms of the contribution thev can make 
to ttjpse ends (Olson, 19?6). Vet, th:> form of fortoal 
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schooling Is distinctive, as Bruner (1966)^ has rlalmed: 
schooling occurs out of the context of activity. Reform 
movements invariably attack the properties of means-7- 
schooling should be more in context and learning should 
occur by doing, ICE is an educational reform in part 
aimed at changing the means of instruction • To this 
extent Judging the value of the means is as Important 
as assessing outcomes • 

Staler o utcomes sh ould be a third basis of an IGE evaluation , 

# 

J I ^hanged pupil outcomes are a result of changed pupil 
activities, then it follows that changed means are in 
part a result of changed teacher actj.vities. One est^^blished 
tnit In IGE schools is changed staff role^. The extent to 
whicii .sfaff changes are reflected in increased knowledge 
about Individuals and ^hooling or in changed attitudes 
and values should also be reflected in an IGE evaluation 
plan. In fact, if IGE is as dynamic as to claimed, then 
the involution of a staff to an increasingly professional 
approach to solving the problems of educating children 
should be evident. 

Hlfl s^jPPQ^tlve systems of . IGE have 

beca incorporated and developed in ja school must be fudg ed, 
Thg seven components of IGE have evolved as practical ' 
features of ICE schools in order to support new Instruc- 
tional method!; which in turn produce desired pupil and 

I'J 



staff outcomes. It tan bt> argued that the efficiency of 

an FCiK school is a lirtiction of which com^nents have 

been implemented and how well they are operating. In 

faci, Klausmeier (1976) claimed that 

High quality instruction is realized in IGE schools 
when conditions such' as the following arfr operative: 

i clearly defined roles and responslbi Itles, shared 

decision making; continuous pupil progress, per- 

• sonallzed instruction, active learning, objective- 

baaed evaluation, involvement of parents and support 
from the cossnunity, and support Ly responsisile 
education agencies [pp. 8-9] . 

Yearly I nc reast-s in the number of schools implementing IGE 
added ti» thf array ol schools that have used components of 
the :?vrtlem {'ci many years have broughl forward demands for evidence 
of the i-{ 1 .'it i veness of the system in various settings and in 
various phases ot implementation. Although evaluations have been 

.atrifd cut in nuiny settings on many aspects, no overall ^valua- . 

f 

f if>n has been carried out. 

As .1 coiqnehcnsive system of cduratlon, ICE is directed toward 
tht' developinent of sel f-ti^ .-ect ion and motivai ion for learning in 
studt'ols as veil as 'ifferent levels of achievement. Further, 
the coroponnits a;e directed toward school staff and community 
members in addition to changing what students do. Thus, evaluation 
a{ an IGE school must go beyond pupil outcome^ or ends. It must 
encompass staff outcomes, the instrt.iction4i raeans and the degree 
of implementation of ICK.. If an evaluation plan can encompass 
all tiu»He^spects» then the features which have made IGE schooling 
sturtssful should he identiflad. 
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AN OUTLINE OF THE EVALUATION PLAN 

Based on the ideas discussed In Chapter I, It should be apparent 
that three things are needed: First, a descriptive framework that 
considers outcomes of IGE as a function of instructional means and 
ot the degree of implementation; second, a plan that ie consistent 
with the powerful flexibility of IGE and yet financially feasible; 
and third, a body of supporting instrumentation and techniques 
to be used in carrying out the plan. 

A ^ vfc' Fran^ vork 

The diagram presented in Figure 3 is intended to show four types 
of varlab'.ri and how they are functionally related. 

Outcomes have been separated into pupil, and" staff outcomes. Both 
Mtts oi outcomes are Illustrated as being multivariate and multi- 
ifvel. Pupil outcomes include achievement in both reading and 
aiiithematlcs, cognitive skills such as conceptualizing and problem 
solving, and self-direction. Staff outcomes Include knowledge of 
lUK principles related to individual differences and instruction 
using the instructional programming model, attitudes about 
children and ficl.ooling. and perceived values of education. 
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Figure 3. Framework for an IGE evaluation. 
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Means of instrAiction have been neparated into three sets of 
activit^i^J^biiscd upon the operating characterintics of IGE gchools; 
namely, the statf activltifjs of the IIC (Instructional Improvement 
Committee) and the I & R Unit (Instruction and Research Unit), the 
activities of the sta^f teacher (both curriculum oanagetnenC and 
pupU Interaction), and activities of pupils. 

The support systegiH for an IGE learning environment have been 
separated into four categories.' The first which includes IGE 
Components 1, 2, ^itid 3 (the nultlunit organisation, instructional 
programming, and evaluation) is seen as iMSt directly related to the 
means of Instruction. The second category , Component 4 (curriculum 
materials compatible vlth Components 2 and 3), Is shovm In the 
figure by identifying the three major curriculum products developed 
for ICE: namely, The Wisconsin Deslsjrt for Reading Skill Development 
(WDRSD) , Developing Mathematical Processes , and the Pre- 

^^'A^^.^^ Skills Program (PRS). At least one such curriculum program 
(not necessarily these) is deemed essential for an IGE school to 
i^perate, Tlie third category which Includes Components 5, 6, and 
7 (home ^school relations, facllitatlve environments and continued 
research and development,) is seen as desirable. These support 
systems are less directly related to instructional means than the * 
other components. However, they should influence the degree to 
which the other components have been adopted, and, in particular, 
should directly affect the aiaount and quality dM^E staff 

♦ 
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development actlvitlejj. The final category of support systems includes 
the teacher training and IGE staff development programs. 

The fourth type of variable shown in Figure 3 is pupil and 
staff b3ckgr«>und. Tliese variables were not previously mentioned 
but have been included because knowledge of prior pupil achieve- 
mvnt, level of motivation, and learning styles are assixmed necessary 

i 

for efticlent grouping of students and selection of appropriate 



activities. Similarly, staff experience with IGE principles, 
with working In groups, and with pupils should be important , 

The functional relationships illustrated in Figure 3 are 
int ended to convey the followj^rtg: The degree of implementation 
ol the h;k support systems along wi'.:h pupil and staff backgrounds 
dirtHtly Influence the means of Ins "Ction in an KJE school. 
The rm^ans ot instruction, along with pupil and staff backgrounds, 
account tor pupil and staff outcomes. 

Strui turc of tju' JiiE J^^Jjia^ 

Given that there are limited resources to examine the frame-- 
work ut variables described above , that instruments or techniques 
ATv not readily available to scale reasonable proxy variables for 
iMch category or subcategory of variables, and that the various 
relationships deyicted in the framework call for different analytic 
strategicfi (status surveys, time-'serles designs, within«school 
and between-school comparisons, etc.)t the following guidelines, 
havi- bt-en adopted to insure that a reasonable portrayal q£ 
W,E schooling ran be obtained. 
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The evalujition should begin by identifying and aettiag the 
cooperation of a large number of IGE schools. A population 
approximately 950 IGE schools was identified In the 
spring of 1976. about 770 of which have both «ftcond" and 
fifth-grade students. -*A stratified sample of approximately 
100 schools is to be drawn. Stratification will be done 
on demographic and IGE support characteristics to insure 
a v-'de variability of schools and situations. 
The evaluation should limit its examination to teachers 
and students at the IG^ equivalents of second and fifth 
grades . Second grad^ ? ^ the earliest at which group- 
admirttstered paper-and-pencil tests can be given to 
children; fifth grade is the last common grade in 
e;^ejaentary schools. 

^the evaluation plan should project the preparation of 
an InsLruraentation survey identifying available self- 
rcT^>r«^ survey and paper-and-pencil test Instruments 
to be used to scale reasonable proxy variables for a» 
many categories of variables as is possible for the 
total population. Thus, resources should not be 
expended on instrument cr test development for use 
with the total population. 

The evaluation plan should project the preparation of 
analysis plan to be followed on the baseline data 
gathered on the 100-school sample, the plan should be 

26- 
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based on a structural equations model which accounts for 
both within-school and bt^tween-3chool variance. 
5\ The evaluation plan should project the preparation of 
several follow-up studies designed to gather other data 
over a longer period of tltm? on subsamples on the 
original population. 
16. Thp evaluation plan should include provisions for the 
*^ R&D Center subcontracting through competitive bidding 

the lOO-school-sample data gathering and other follow--up 
studies for which the Center does not have adequate staff, 
7, TJie evaluation plan and its execution should be monitored 
by the Center IGE evaluation staff with the assistance 
of an IGE Evaluation ikivisory Panel* 
By following these guidelines, it is assumed that the evaluation 
to hv carried out will provide an adequate examination of the re- 
lationships among variables as described in the framework and 
at the same time be flexible in its approach to the study of IGE 
schooUng, From this study the features which have made IGE a 
s access ful innovation in An^rican elementary education should be 
identified. 

OiitUne of the Plan 

The evaluation of IGE has been ^separated into four phases. 
The first phnse will be a large sample investigation whose 

purposes are: 
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1. to determine the degree to which the seven cootponents 
of IGE have been implemented * 

2. to ascertain the relationship of degree of coo^sonent 
implementaticu to means of instruction 

3. tc ascertain the relationship of degree to coii^onent 
implementation of staff outcomes 

4. to ascertain the relationship of degree of cotaponent 
Ifflplementatlon to pupil outcomes 

It is this large sample study that will provide the basic 
information about IGE schooling. Because of the size and scope. 
It will be initiated according to the timeline which appears in 
•Figure 4. Tlie initial item in tnat figure refers to n document 
to be prepared by the R&D Center staff prior to subcontracting 
the Phase I Evaluation. This first document will detail the 
school sampling plan and instruments to be used to gather the 
large sample base-line data (completion date by NDveni>er 1, 1976). 
This document will specify the following information: First, for 
each variable one or n»re proxy variables will be identified. 
For example, for the variable, pupil mathematics achievement, 
the proxy variables computation, concepts, applicajtions , and 
problem solving, have been Identified. Similarly, 'proU ictlve 
learning t Ime, appropriateness of activity, and level of motivation 
have been identified as proxy variables for pupil activities, 
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Figure 4. • Timeline for IGE Evaluation: Phase I — large sau^le survey, 
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Then, one or more Instruments will be described which are to be 
used to scale that proxy variable. For example. The Comprehensive 
I^>X^. 9 ^" PA^iy Skills fl975) will be used to scale pupil computation, 
concepts, and application performance. 

The second item In the figure is a solicibation for a sub- 
contract to carry out the large sample study. This Is to be 
prepared starting October 1. 1976, reviewed and bid by December 15, 
19 76, md awarded by March 1, 1977. Data are to be gathered b/ 
July I, 1977, and data summarizatian carried out and reports 
written by October 1, 1978. The .final aspect chip phase will 
be an extensive analysis of the 100-school-survey data. A 
document outlining the analysis to be followed will be prepared 
by June 1, 197?. Analysis of the data and reporting findings 
will proceed thereafter and be conipletei by September 1, 1978, 
This analysis will be conducted by Center staff under the 
direction of Professor Gary Price, 

The se-ond phase will be a small sample (30 schools) follow- 
up investigation whose purposes are: 

■ ■ t« determine the validity of the self-report data 
gathered in the large sample study • 

2. to use Interview and observation data to extend 
the Information about each catego^ry of variables 

3. to gather cost data so that some indications of 
cost effectiveness can be deterialned 



This validity-extensi^ study will hjo carried out to clarify and 
fill out the knowledge gained in Phas^ I about the variables and 
how they a^re relating In IGE schooling. The timeline for this 
ph^iBe »^rpearF in Figure 3. Planning for this phase will biegin 
as soon as the instrumentation document for rhase I is completed. 

Plans for gathering of cost data will be carried out under the 

} 

direction of Professor Richard Rossfni Her . This phas^ will also 

be subcontracted (during Spring 1977) and data are to be gathered 

during the school year 1977-78, The analysis should be done and 

reports written by October 1978. 

The third phase wiH also he a small sample (15 schools) 

invest igat l4>n using a subsainple of Phase I schools. The purpose 

of this study are: 

1 . to determine the degree of reform evident in IGE schools 
2. to determine the degree of renewal evident in ICE schools 

This re to nn- renewal Study will be a sociological investigation of 

I UK Si'hoo Is . 

The qut»st ion being asked Is: Has the IGE view of schooling 
permeated the structure of the classroom? It would appear that 
there has been a tradition in which routines, subjects^ facts, 
techniques, and desirable behavior patterns serve as scripts 
tor teaching. In a review of the 1970 Carnegie Commission 
Report » William K, Stevens wrote that 
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most schools are preoccupied with order^ control and routine 
for the Hake of routine; that students essentially are sub- 
jugated by the schools; that by practicing systei&atic 
repression, the schools create many of their own discipline 
problems; and that they pron^te docility » passivity and 
conformity in their students • . . . 

The teachers are said to L treated as subserviant employees 
whose job Is to take orders ai^d punch the time clock every 
day» am. whose competence is judged not fay what and how 
their students learn, but' by how well they control their 
classes . . ♦ • Teachers assufae that pupils cannot be trusted 
* to act in their own best interests . . and principals nu^ke < 
staiilar assumptions about tea^^hers • - . . Teachers become 
primarily disctp' inarlans , and discipline Is defined as *'the 
absence of- noise and movement." • . . One result of all 
thin . . 1h to destroy students* curlousity along with 
their ability — ^more serious, their desire — to think and act 
for themselves' ... it is not the children who are dis- 
ruptive . . • It Is the formal classroom that is disruptive — 
of childhood Itself [pp. 5-7] . 

The Insldlousness of the '^hidden school curriculum" lies not 
so much in its overt rules and constraints, but rather in the 
pot one V of its invisible nature whereby all participants in the 
educational process implicitly accede to its tacit demands. 
These dem-indB or tacit assumptions may include or define the nature 
of the expectations of student and teacher as determined by the 
physical iMiii*! ronment , the nature of the valuing of what it is 
that is important to "know,** the nature of the ^rucess of the 
t'ommunirat ion of information, the nature of the social power 
structure, and finally the nature of the economic or social 

valuing of education as a commodity. 

Early in the development of IGE, Kiausmeicr made explicit 
how an IGE school in the future would operate in contrast 
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to the current elementary schools (Klausmeler, Morrow, & Walter, 



1967)* Implicit in the contrai^t was the expectation chat the 
"hidden school curriculum'' would be changed. Thus^ IGE schooling 
Js indeed a real reform and not just a new system to routinlze 
or legitimatiase current practice* To those investigators who 
have worked in IGE schools, there is subjective evidence that 
in sorae schools real reform has occurred while in others with 
some superficial IGE trappings, the old subserviant environment 
s^ill remains • 

4 

A part of reform is renewal. That is, as a school evolves 
from the traditional environment to one with new structure and 
values, the participants sense and participate in activities 
which renew or update their knowledge , skills, or valtses . 
Becoming an IGE school is nio'-e than changing surface character- 
istics. It is changing one*s ideas about schooling. Such 
changes are evolutionary and involve the active searching for 
new infortnation, new processes, etc. 

In particular, this phase will concentrate on particular 
>schnols regarded as successful, A document outlining the plan 
tor this phase will be prepared by , April 1977. Data will be 



gathered in the 1977-78 school yea^. This phase will be 
ronducted by Center staff under the direction of Professor 
Thomas Popkewitz* ^ 




The fourth and final phaae of this plan will be another small 
scale study focusing on the use and effectiveness of the three 
priiaarv curricular projects developed at the Wisconsin Research 
and Development Center for Cognitive Learning, the Wisconsin Design 
for Reading Skills Development (WDRSD) , the Developing Mathematical 
Processes (DMP) , and the Pre-ReadinR Skills Program (PRS) . Each 
program was developed to be compatible with the IGE system and 
incorporates two of the components of IGE, the model of instructional 
programming and the model for evaluation. 

The Wisconsin Design for Reading Skill Development is an 
objective-based system designed to manage the development of 
reading skills for children in grades kindergarten through six. 
The components of the WDRSD are: skills and objectives, assess- 
ment materials, instructional resources, and management techniques 
and materials. Approximately 5,000 schools are in various stages 
and degrees of implementation of the WDRSD. A more detailed 
description of WDRSD is given by Otto (19763 • 

leveloping Mathematical Processes (DMP) is a complete in- 
structional program for elementary mathematics, grades kinder- 
garten through six. The printed materials used in the DMP 
program are: resource manuals » teacher *s guides, s^**dent 
booklets, student guides, printed materials kit, physical 
materials kit, pre-assessment package-, topic inventories, 
and pupil performance records. More thar 400 schools are 
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using various parts of . the'program. A more detailed description 
-t5t DMP Is given by Romberg (1976)/. 

The Pre-Ri^adxni Skills Program (PES) Is designed to provide 
instruction in .re-reading skills at the kindergarten level. 
PRS teaches f.ve basic pre-reading skills: attending to letter 
order, attending to letter orientation, attending to word detail, 
-sound matching and sound blendings. The^cou^onents of the program 
are: criterion-referenced diagnostic tests, a schedule book, a 
r^-source file, a management system, a set of teacher's guide 
folders, and multiple copies of classroom games and manipulations. 
i'RS. is being usrd in approximately 2000 classrooms. A more de- 
talled description of PRS is given by Venezky and Pittelman (1976). 

Ail three programs, WDRSD. DMP, and PRS, underwent extensive 
.•V. uations and field tryouts in their formative stage. Information 
was gathered fsom content and measurement experts, teachers, and 
.-■valuatorTs. The major elements of the programs were completed 
bv lall of i97b and are either in publication or in use. 

Now that WDRSD. BMP, and PRS are fully implemented summative 
questions need to be answered. The sound structure of the de- 
vt li.pmental processes and formative evaluations provide a solid 
base from whit h to inquire about such questions. 

Studies have been performed for each of the three programs 
that indicate parts of the programs are effective. Questions 
-still retrain about the effectiveness of the tota]. programs and 
how students are prepared for future learning. 
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Each program is being xxs^d by a number of scho^>ls throughout 
the country in a variety of ways. For laxamplt?, each ^prograia is 
being ustfd In both IGE and non-IGE schools. Exi^ctly, what is 
the capabil it y of each program to be used effectively in a number 
of different situations is unknown • 

Phase IV of the IGE evaluation has two major purposes : 

K to describe how WDRSD, UMP» and PRS are being iniplemented 
atid what their effects are 

2. to compare the use and nnnuse of these programs within 
IGE and non-IGE settings 
Although Phase IV will be summat ive in nature. Information collected 
will help to make changes in the materials, the instructional pro- 
Krainmin** model, and teacher training procedures. 

The goals of Ptiase IV of the ICE evaluation are: 

1. TO determine the effects of WDRSD, DMP, and PRS on mastering 

2. to deti^rniine whether WDRSD, DfiP, and PRS meet their design 

oh ]tri t i ves 

3. to identify how WDRSD, DMP, and PRS are being used 
to identify what management procedures and teacher 
behaviors are being used 

5* to identify how the school setting, IGE or non-IGE, 
relates to the effectiveness and administration of 
WDRSD, DMP, and PRS 
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6. to identify pedagogical-pyschologic.al problems which need 
more thorough investigation 

Phase IV will be divided i-ntoy two data collection periods. 
Thy first period. Descriptive Study, will be during the school 
year 1977-78 and will involve a sample of schools for each of 
three progr.ims. The second period. Comparative Study, will be 
during the next school year, 1978-79. and vlll involve an expanded 
samplf of schools for WDRSD and DMP to include XGE and non-lGE 
schools not using either program. PRS will not be included in 
the Comparative Study . 

Matched-pairs of WDRSD schools, matched-pairs of DMP schools, 
and matched-pairs of PRS schools will be selected for the Descriptive 
Study. Each pair of schools will contain one IGE school and one non- 
u:k school. The schools within pairs will be matched on deiaographlc 
and other external variables . 

Thv Comp.irative Study will use soae of the same schools as were 
tj-^fd in the Descriptive Study. In addition, IGE and non-IGE schooi«- 
not using WDRSD and DMP will added to the sample. The sample 
of schools will be selected so an equal number of schools is re- 
presented from each of these four groups; 

1. the TOE Unit using WDRSn (DMP) materials 

2. the IGE Unit using materials other than WDRSD (DMP) 

3. the Standard Class using WDRSD (DMP) materials 

A. the Standard Class using materials other than WDRSP (DMP) 



Two levels oi instruction will be used» cue level from grades 1 
2, and 3 and one froia grades 4^ 5» and 6. 

The purpose of the Descriptive Study is to collect descriptive 
inf orim^^t Ion about how UDRSD, DMP^ and PRr# are being used and what 
their effects are. Student baseline dat.i will be collected during 
Sopteniber. Teacher questionnaires, teacf»sr record forms, teacher 
interviews, and classroom observations will be conducted during 
the yetfr. In May students will be tested on self -concept , achieve-* 
>raent» and other cognitive variables. Two types of achievement 
measures will be used. One will be criterion-referenced tests that 
will be specific to the content objectives of the programs. The 
other will be standardized achievement tests. 

The prupose of the Comparative Study is to study in more 
detail the use of WDRSD and DI*fP in some of the schools used in 
the Descriptive Study and at the same time compare these schools 
with IGE ard non-'TGE schools which are not using either prograts, 
The CoTTiparat ive Study will provide inforioation about the necessity 
of using WDRSD and DMP as part of the ciupport system for IGE 
schools and how the effects of these programs -differ from other 
alternatives. 

The planning, instrument selection, and sample selection 
will be done during the winter and spring of 1977. During the 
Kuimnt«r of 1977, on-site liaison personnel will be selected 
and trained to administer instruments and conduct classroom 
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observations. Data will be analyr-ed durl,ng the sunanGr and into th^ 
.fall atter each study. Two major reports will he written, one for 
WDRSD and one for DMP during the fall of 1970. A shorter report 
will be written for PRS. 



Sutaroary 

As envis oned, this IGE evaluation plati should provide NIE, 
the R & D Center, current IGE schools, potential IGE schools , 

and the education profession with a comprehensive picture of IGE 
in action. The lOO-school survey which exaaines the relationships 
among the categories of variables described in the framework should 
provide baseline data about IGE schooling. The small sample studies 
then should add information and clarify relationships. We should 
ht' abli- to weave the findings from the four phases together so 
that a comprehensive picture of IGE emerges. This olcture should 
i 1 liminatt' the features that have made IGE a successful refona 
raovetnent in American education. 
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THE IGE EVALUATION PLAN IN PERSPECTIVE 



The purpose of this chapter Is to relate the plan being 
proposed to the voluininous current literature on evaluation. 
In particular, four perspectives on evaluation are briefly 
discussed and tlie IGE plan related to each. 



Ever since Cronbach (1964) and Scriven (1965) made the 
distinction between "formative" and "summative" evaluations 
in the literature, authors have vied to Identify and clarify 
types, phases, sequences or standards, and to develop checklists. 
For example, Romberg (1976) Identified four phases in the 
i-valuation of the mathematics program developed for IGE: 
namely design evaluation, formative evaluation, implementation 
i^vai uat ion , and sunnnative evaluation (s^e Figure 6). The 
labels were chosen to emphasize the fact that different 
ijuesrlons were raised at different times in the development 
of thai program. To answer the questions, different information 
needed to be gathered in different ways. A total product eval- 
uation encompasses all such questions. 



1 ypes o f Eva 1 ua t ion and Standa rds 
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Figure- 6» Four Hl/iy^on in developing and evaluating, DM1', 
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Scrivtfn has carried this differentiation further in his 
"Product Evaluation Profile (PEP)'' (Scriven, 1974). He prgued 
that every product should be rated on 13 Items and even suggested 
criteria for rating each Itexa on a flve-polnt high/ low scale* The 
13 items he identified are: 



1. 


Need (justification) 


2. 


Market (dissemination) 


3. 


Perfc/naance — true field trials 


4. 


Performance — true consumer 


5. 


Performance — cruc ial comparisons 


6. 


Performance — long term 


7. 


Performance — side effects 


6, 


Performance — process 


9. 


Per foriaance — causation 


10. 


Performance — statist teal slgni f icance 


1 1 . 


Performance — educat iona 1 s i gnl f icance 


12. 


Costs and cost-effectiveness 


13. 


Extended support 



Unfortunately, the proposed IGE evaluation will not fit neatly 
into any such scheme. Romberg's sequence a.id Ccrlven's ?EP both 
are appllrablo primarily to currlcular products and not to a complex 
program such as IGE, But, the IGE evaluation plan is consistent 
\*rith the notion that there are different questions which need 
answers . Thus, the different phases of the plan require different 





kinds of da&a« difturent desigaSt difterent methods of aoalyfii^iti, 

and different reports of results,-^ 



Eval uat ion as Decision-Ma king^ Demonstration^ or Re flective Inquiry 

Dicr i onary defies evaluation as the procedures one 

u.4es *'to jailge or etennine the worth or quality of But what 

is th^ purpose of judging the value of anything? 

Stuftlebeam for the Phi Delta Kappa National Study on Evaluation 

stated that '*the purpose of evaluation is to provide information for 

decision making [ 1970. p, 2]." He further stated that 

These decisions m* y be divided into four classes called 
planning, structuring, implementing, and recycling decisions. 
^AA^^^I^J^^ dec is ions pertain to th" selection of objectives. 
St ructur in^ decisions are those involved In designing pro-- 
jecfs to achieve stated objectives, Thx>se required for 
operational izlng and executing a project design are referred 
.o as implemtMit inji decisions, and recycling decisions refer 
especially to the judgment of and reaction to project re- 
sult.s [p. 1^70, p. 2]. 

From titis porspi^ct 1 ve , the decisions to be made should be specified 

:\ priori by the investigator. Then, the desl^^n, data, and analytic 

pnueduros arv. specified in light of those decisions- 

For t\u variety of teacher training projects funded by National 

T^Mchcr Corps, Romberg and Fox (1976) identified demonstration as 

f iu' purpost* ol an evalun Ion study. They stated 

The purpose of d unstration is to cotEmaunicate to those 
not originally involved wlth\a particular program the 
salient features of the program. The overriding question 
is: What does an outsider-^ have to know to try some of 
the specific features of the training strategy in another 
setting?' Thus, the special challenge of desK>nstratlon 
can be stated as '^describing the Successes and failures 
of sperific features of a training program for possible 
replication at other sites [p. 2) 
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The salient dcmonstratable features of a program likely cannot 
be Identified prior to initiation* Thus> from this perspective 
the design, data^ and analytic procedures must evolve during the 
developmi»nt and iinpleinentat ion of the program. 

Parlelt and Hamilton (1972) argued that, since innovative 
educational programs are vulnerable to manifold extraneous 
influences in the real milieu of schools, an alternative method- 
ology which |they have labeled "'Illuminative Evaluation" should 
be followed. They statec' 

iJluminative evaluation takes account of th:^ wider contexts 
in which educational programs function. Its primary concern 
is with description and interpretation rather than measure-* 
ment and prediction. It stands unambiguously within the 
alternative anthropological paradigm. The aims of Illumi- 
native evaluation are to study the innovatory program: how 
it operates; how it is influenced by the various school 
situations in which it is applied; what those directly 
concerned regard as its advantages and disadvantages. ; and 
how students* intellectual tasks and academic experiences 
are most affected. It alms to discover and document what 
It is like to be participating in the scheme, whether as 
tfa<:her or pupil; and, in addition, to discern and discuss 
the innovation's most significant features, recurring 
ccuiromitant s , and critical processes [pp. 8-9] . 

In t)us pt-rspo(*ti ve evaluation becomes reflective inquiry. No 

longer are "decisions to be made" or ^'features to be desKjnstrated' 

o! primc'iry roncern. Now the investigator shifts methodologies 

t roni psyt ;iologiral to sociological paradigms. 

Ti Khould be obvious, given the framework for the IGE 

r' 

evaluation and the proposed ph«ises, that reflective inquiry is 
ai the lieart of this plan, {We hope to uncover some of the 
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strengths and weaknesses of IGE schools in practice and to Identify 
the Intended and unintended consequences of IGE schooling. The 
information generated and relationships studied should be a rich 
source of ideas for further investigation. However, it is hoped 
the findings would help school staffs and funding agents make 
reasonable decisions in the future, such as whether to implement 
IGE, or whether to fund further investigations. Slniilarly, one 
could reasonably anticipate that demonstratable features of 
sucressful ICE schools could be identified and later incorporated 
in the programs of other schools . ^ 

rhc Re lationsh ip oI_EyajAiat_lon t_o De velopment and Implen i entatlon ' 

The problems Involved in evaluation of IGE schools are in 
part dxif to the problems of implementing any Innovative program 
in a social institution which has proven to be extremely resistant 
to thangp. 

The liK-rature on planned change is wide in scope and vast 
in quantity. Have lock (1969) reviewed approximately 4000 sources 
m liis ana lysis of the theoretical concepts and the research 
evidence dealing with change in education, agriculture, medicine, 
and otht-r fields. Many authors have attempted to provide a model 
or conceptual framework for planned educational change. 

The many models of the change process can be grouped into 
three main classes. The research-development-dif fusion perspective, 
associated particularly with Cuba (1968), is characterized by a 

■ -46 ■ 
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fational sequence of coordinated activities, a division of labor. 



^'center to* periphery" notion of development and implementation 
focuses on whether the user at the periphery has adopted and is 
using correctly the products developed at some central setting* 
This: model is often criticized for taking too little account of 
the users' needs. Also, it fails to emphasize the importance 
of schools and other client systems In generating worthwhile 
problems for research and development, as Klausmeier (1968) 
and Romberg (1970) have pointed out. 

The social interaction perspective is basically sociological 
in nature, and considers the path taken by an innovation already 
in existence as it itK^ves through a social system. This model 
emphas^^es characteristics of innovators (Rogers, 1965) and 
theories of rejection (Kicholz, 1963) as well as adoption. 



Weakness e.^: of this model include Its la*^k of concern about viow 



The third major type of model for the change^ process views 
thi' user as a problem solver. The points stressed by the problem- 
solv<,r perspective are (1) starting with the user's need and its 
diagnosis, (2) pr<widing non-directive help from outside, and 



(3) encouraging the user to develop his own internal resources 
and his rapacity for se If -renewal . This model is closely 



asHot lated with the human relations tradition of planned change . 



and a rather passive targ<*t population. 



Evaluation in this 




make . 
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The main drawbacki§ of this perspective, according to Havelock (1969), 
are that it puts great strain on the user, it minimizes the im- 
portance of outside resources, and it cannot be lii4>lemented on 
H massive scale. 

The IGE implementation strategy has attempted to combine 
aspects of both the research-development-^dif fusion perspective 
and the user-^as-problero-solver perspective. The ddoptiotx of 

i 

the IGE support system is seen as necessary structural features 
which makes it possible for school staffs to solve the problem 
of how to differentiate instruction in an efficient and effective 



m*mner. MUS or the IPM are not "teacher-proof"; instead they are 
mechanisms to facilitate professional judgments. In fact, 
teacher and pupii activities ehoold be different for different 
staffs and pupils. From this it should be evident that variation 
Is anticipated both in a school and between schools and that 




are important . Thus, the evaluation plan not only includes 



i^stimates of the degree of IGE component implementation and 



of pupil and staff outcomes, it also attempts to estimate 



the differential quality of Instruction, 



i ) ver c nrn i Impi^dlmenls 



David Berliner in his recent paper titled "Impedin^nts 




to the SCudy of Teacher Effectiveness" (1975) identified an 



extensive list of problems facing researchers who are examining 





the relationships between teacher behaviors and pupil performance. 

In this rather pessimistic overview, he examined what researchers 

have done in the field of teacher effects research* The IGE 

evaluation plan was not designed to overcome all t^e probiems he 

identified. Comments need to be made ^bout t^e three major 

categories of impediments, napaely instrumentation, methodology, 

and statistics. 

Clearly, the Instruments one uses in any kind of research 

are extremely important. Researchers examining teacher effects 

have typically relied very heavily on objective tests. The 

stereotype investigator steps into the school environment ^quickly, 

gathers a variety of survey data, steps out and spends most of 

his tisue, effort, and resi^urces analyEing that data. The 

primary criticism of this approach is that theVe is little under-- 

standing of what the data mean. Some critics of this empirical 

approach would dismiss all such data and turn to case studies 

as an only sensible way of gathering sensible data* For the 

ir.E evaluation, we have combined both approaches. Tirst, we 

propose to collect objective test data on as many variables 
< 

as possible. But, we are not relying solely on that information 
to weave a picture of IGE in action. Phases II, III, and 
IV of the plan are designed to give meaninjg to the variables 
and relationships anK>ng variables in the IGE framework. The 

^. ■ ■ . ■ ■ 

pracHcality of combining both objective and subjective 



m 

techniques in evaluation has been demonstrated by Fox, et al. 
(1976) in a recent evaluation of Teach^-r Corps Training 
Institute. 

A second problem in instrumentation ha^; been the quality 
of instruments. Poor scaling methods have bei^n used for in- 

adequately conceived proxy variables for important conceptual 

\ 

variables in nuiny studies* While the IGE evaluation plan can- 

\ 

not overcome all of these problems with the resources available » 

we have attempted to identify multivariate-multilevel outcomes 
and use more than one instrument to scale each of the proxy 
variables. In addition, the extensive information gathered in 
Phases II, III, and IV should give us clues about the inadequacies 
of various instruments in the study. 

The primary methodological probLems that Berliner identified 
■ire: (I) the inadequate framework for the conceptualization .if 
ttMther t.isks, .ind (2) the assumed direct relationship between 
teacher tasks and pupil performanre. For the ICE evaluation plan, 
wo have nddrt-HSfd these problems directly . First, tea<-.her tasks 
are not seen as initial independent variables. Rather they are 
interim variables dependent upon the supporting structure of 
tlse school organisation, teacher background, and pupil background. 
StTond, we have not assumed a direct conpection between teacher 
tasks and pupil performance. We, like Harnischfeger and Wiley 
-(19 75) ,, assume that teacher tasks are reflected in pupil activities 
which in turn are reflected in pupil performance. 



Because of the instr\i«encatlon and methodology » manipulation 
of statistical techniques has become a primary area of emphasis, 
Berliner correctly points out that the procedures used almost 
alwayti do not adequately meet the requirements of the situation 
beinR studied (Berliner, p, 26). In part, investigators 

have had to rely solely on statistical techniques to give answers 
rather than using a comhinatlon of statistics and professional 
inference from subjective techniques. in the IGE evaluation 
plan, we arc aware of these problems . We will be attempting to 
interpret the information from the studies in light of the 
limitations of the methodology. 

I n S u nsaa r^' 

The 1 evali|atlon plan has b<*en conceived ir- light of the 
variety of educational evaluation activities of the past decade . 
Wf hive tried to incorporate <;ome of the best ideas (1 ike the 
tomb inat ion of objective and subjective techniques) , the most 
important variables (such as productive learning time ir the 
iatc^ory of pupil activities or degrt^e of structuring in teacher 
activities) that other researchers have identified in the past 
few years. We have tried to put the evaluation plan In an 
adequate^ f riimi*wo rk • ^\nd, w<$ are proposing to use appropriate 
techniques combined with subjective methods for the examination 
and interpretation of the data. Together we should be able to 
identify the rharacteris ics which have made IGE schooling so 
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successful. In conclusion, given the tesources available lo carry 
out an evaluation ot IGE. we are confident that the plan will 

accomplish its objective. 
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